Display apparatus, terminal apparatus, and controlling methods thereof

ABSTRACT

A display apparatus, a terminal apparatus, and controlling methods are provided. The display apparatus includes: a communicator to communicate with a terminal apparatus or a relay server in order to receive collected status information about at least one peripheral device from the terminal apparatus, a display unit to display a user interface (UI) screen; and a controller to generate a control UI for controlling the at least one peripheral device or a security UI for monitoring a peripheral space through the at least one peripheral device based on the status information about the at least one peripheral device and based on whether a communication with the terminal apparatus is possible, thereby controlling a home device t in real time according to a communication status with the terminal apparatus.

CROSS-REFERENCE TO RELATED APPLICATION(S)

This application claims priority from Korean Patent Application No.10-2013-0169113, filed on Dec. 31, 2013, in the Korean IntellectualProperty Office, the disclosure of which is incorporated herein byreference in its entirety.

BACKGROUND

1. Field

Apparatus and methods consistent with exemplary embodiments relate toproviding a display apparatus, a terminal apparatus, and controllingmethods thereof, and more particularly, to providing a display apparatusthat provides a home network service, a terminal apparatus, andcontrolling methods thereof.

2. Description of the Related Art

The recent development of communication technologies, has led to anemergence of various technologies directed towards a home network systemestablishing, integrating and/or managing a network between home devicessuch as a smart TV, a smart air conditioner, etc. installed in a home.According to the various technologies, a user may integrate and managethe home devices by using a portable terminal apparatus such as asmartphone.

According to most technologies that have been commonly used, researchedand/or developed, an operation status of a home device is monitored on aportable terminal apparatus through a data communication performed usingrelay terminal apparatuses that integrate and manage the portableterminal apparatus and the home device. The home device is controlledaccording to a user command input through the portable terminalapparatus.

Although home devices, such as a smart TV, a smart air conditioner, arobot cleaner, or the like, have various functions, these variousfunctions of the home device have not been used via the above describedand currently prevalent home network system.

Therefore, there is a need for methods of using various functions of ahome device through a home network system.

SUMMARY

Exemplary embodiments address at least the above problems and/ordisadvantages and other disadvantages not described above. Also, theexemplary embodiments are not required to overcome the disadvantagesdescribed above, and an exemplary embodiment may not overcome any of theproblems described above.

An aspect of the present disclosure provides using various functions ofa home device through a home network system.

Another aspect of the present disclosure provides a home network serviceappropriate for a user according to a position of the user.

According to an aspect of an exemplary embodiment, a display apparatusincludes a communicator configured to communicate with at least one of aterminal apparatus and a relay server to receive from the terminalapparatus collected status information corresponding to at least oneperipheral device, a display unit configured to display a user interface(UI) screen, and a controller configured to generate at least one of acontrol UI for controlling the at least one peripheral device and asecurity UI for monitoring a peripheral space using the at least oneperipheral device based on the status information corresponding to theat least one peripheral device and based on whether communication withthe terminal apparatus is possible, and display the at least one of thecontrol UI and the security UI on the display unit.

According to another exemplary embodiment, if communication with theterminal apparatus is possible, the controller generates a control listinformation about at least one controllable peripheral device, fromamong the at least one peripheral device, based on the received statusinformation, and generates the control UI comprising a control menucorresponding to one of the at least one controllable peripheral deviceselected based on the control list information.

According to another exemplary embodiment, if communication with theterminal apparatus is not possible, the controller generates a securitylist information comprising identification information indicating the atleast one peripheral device to be monitored and an area informationdepicting a monitoring area based on the received status information andsetting information corresponding to each of the at least one peripheraldevice.

According to another exemplary embodiment, the controller furtherincludes generate a user certification UI for certifying a user inresponse to one of the at least one peripheral device being selectedbased on the security list information, request the terminal apparatus,using the relay server, to monitor the selected one of the at least oneperipheral device in response to an encryption key input on the usercertification UI corresponding to preset encryption information, andgenerate a security UI for displaying image information that is capturedby the selected peripheral device and received from the relay server,according to the monitoring request.

According to another exemplary embodiment, the security UI comprises amonitoring control menu for controlling a monitoring operation of theselected peripheral device.

According to another exemplary embodiment, the security UI furthercomprises an editing menu for editing an image captured by the selectedperipheral device.

According to another exemplary embodiment, the controller generates thecontrol list information based on an execution mode of the displayapparatus, and the execution mode is at least one of a first executionmode activated on a quick menu, a second execution mode activated on alock screen, and a third execution mode in which a home networkservice-related application is activated.

According to another exemplary embodiment, the controller generates afirst control list information comprising the at least one controllableperipheral devices in the first execution mode and generates a secondcontrol list information comprising one activated controllableperipheral device from among the at least one controllable peripheraldevice in the second execution mode.

According to another exemplary embodiment, if in the third executionmode, the controller generates a control UI comprising status-relateddetailed information and a control menu of the at least one controllableperipheral device based on the received status information regardless ofwhether communication with the terminal apparatus is possible.

According to another exemplary embodiment, According to another aspectof an exemplary embodiment, a terminal apparatus includes a communicatorconfigured to periodically communicate with at least one peripheraldevice, a storage unit configured to store status information about theat least one peripheral device, and a controller configured to, inresponse to a status information request message requesting statusinformation of the at least one peripheral device being received from adisplay apparatus, control the communicator to transmit, to the displayapparatus, at least one of status information about at least onecontrollable peripheral device, from among the at least one peripheraldevice, and the status information about the at least one peripheraldevice to be monitored based on the status information stored in thestorage unit and based on whether a communication with the displayapparatus is possible.

According to another exemplary embodiment, if communication with thedisplay apparatus is possible, the controller transmits the statusinformation about the at least one controllable peripheral device basedon the status information stored in the storage unit and, in response toa control command being received from the display apparatus, transmitsthe control command to one of the at least one controllable peripheraldevice corresponding to the received control command.

According to another exemplary embodiment, if communication with thedisplay apparatus is not possible, the controller transmits the statusinformation about the at least one peripheral device to be monitored tothe display apparatus through a relay server based on the statusinformation stored in the storage unit and, in response to a monitoringperformance command being received from the display apparatus throughthe relay server, transmits the monitoring performance command to one ofthe at least one peripheral device corresponding to the monitoringperformance command, and transmits image information captured by the oneof the at least one peripheral device to the display apparatus throughthe relay server according to the monitoring performance command.

According to another exemplary embodiment, According to another aspectof an exemplary embodiment, a method of controlling a display apparatusincludes periodically communicating with a terminal apparatus or a relayserver to receive collected status information about at least oneperipheral device from the terminal apparatus, generating at least oneof a control UI for controlling the at least one peripheral device and asecurity UI for monitoring a peripheral space through the at least oneperipheral device based on the status information about the at least oneperipheral device and based on whether a communication with the terminalapparatus is possible, and displaying the at least one of the control UIand the security UI.

According to another exemplary embodiment, the generating at least oneof the control UI and the security UI includes, if communication withthe terminal apparatus is possible, generating control list informationabout at least one controllable peripheral device, from among the atleast one peripheral device, based on the status information, and inresponse to one of the at least one controllable peripheral device beingselected based on the control list information, generating the controlUI comprising a control menu corresponding to the selected controllableperipheral device.

According to another exemplary embodiment, the generating at least oneof the control UI and the security UI includes, if communication withthe terminal apparatus is not possible, generating security listinformation comprising identification information indicating the atleast one peripheral device to be monitored and an area informationdepicting a monitoring area based on the status information and settinginformation corresponding to each of the at least one peripheral device.

According to another exemplary embodiment, the generating at least oneof the control UI and the security UI further includes generating a usercertification UI for certifying a user in response to one of the atleast one peripheral device being selected based on the security listinformation, requesting, in response to an encryption key input on theuser certification UI corresponding to preset encryption information,the terminal apparatus, using the relay server, to monitor the selectedperipheral device, and generating, in response to image informationbeing captured by the selected peripheral device and being receivedaccording to the monitoring request, the security UI for displaying thereceived image information.

According to another exemplary embodiment, the security UI furthercomprises a monitoring control menu for controlling a monitoringoperation of the selected peripheral device.

According to another exemplary embodiment, the security UI furthercomprises an editing menu for editing an image captured by the selectedperipheral device.

According to another exemplary embodiment, the control list informationis generated based on an execution mode of the display apparatus, andthe execution mode is at least one of a first execution mode activatedon a quick menu, a second execution mode activated on a lock screen, anda third execution mode in which a home network service-relatedapplication is activated.

According to another exemplary embodiment, the generating of the controllist information includes generating a first control list informationcomprising the at least one controllable peripheral device in the firstexecution mode, and generating a second control list informationcomprising one activated controllable peripheral device from among theat least one controllable peripheral device in the second executionmode.

According to another exemplary embodiment, the generating of the controlUI includes if in the third execution mode, generating the control UIcomprising status-related detailed information and a control menu of theat least one controllable peripheral device based on the received statusinformation regardless of whether communication with the terminalapparatus is possible.

According to another aspect of an exemplary embodiment, a method ofcontrolling a terminal apparatus includes periodically communicatingwith at least one peripheral device to receive status information aboutthe at least one peripheral device, storing the received statusinformation about the at least one peripheral device, receiving a statusinformation request message requesting status information of the atleast one peripheral device from a display apparatus, and transmittingat least one of status information about at least one controllableperipheral device, from among the at least one peripheral device, andthe status information about the at least one peripheral device to bemonitored, to the display apparatus based on the stored statusinformation and based on whether the communication with the displayapparatus is possible.

According to another exemplary embodiment, the transmitting of thestatus information includes if communication with the display apparatusis possible, transmitting the status information about the at least onecontrollable peripheral device to the display apparatus based on thestored status information, and in response to a control command beingreceived from the display apparatus, transmitting the control command toone of the at least one controllable peripheral device corresponding tothe received control command.

According to another exemplary embodiment, the transmitting of thestatus information includes if communication with the display apparatusis not possible, transmitting the status information about the at leastone peripheral device to be monitored, to the display apparatus througha relay server based on the stored status information, in response to amonitoring performance command being received from the display apparatusthrough the relay server, transmitting the monitoring performancecommand to one of the at least one peripheral device corresponding tothe monitoring performance command, and transmitting image informationcaptured by the one of the at least one peripheral device to the displayapparatus through the relay server according to the monitoringperformance command.

According to another aspect of an exemplary embodiment, a method ofcontrolling at least one peripheral device includes transmitting, to theat least one peripheral device, a request for status information of theat least one peripheral device, receiving, from the at least oneperipheral device, the requested status information, generating at leastone of a control user interface (UI) for controlling the at least oneperipheral device and a security UI for monitoring a peripheral spaceusing the at least one peripheral device based on the received statusinformation and a communication status information, and transmitting, tothe at least one peripheral device, a user command to control the atleast one peripheral device, input by a user in the at least one of thecontrol UI and the security UI.

BRIEF DESCRIPTION OF THE DRAWINGS

The above and/or other aspects will be more apparent and more readilyappreciated by describing certain exemplary embodiments with referenceto the accompanying drawings, in which:

FIG. 1 is a block diagram of a home network system according to anexemplary embodiment;

FIG. 2 is a flowchart of a method for controlling a peripheral device ina home network system, according to an exemplary embodiment;

FIG. 3 is a flowchart of a method for providing a security service usinga home device in a home network system, according to an exemplaryembodiment;

FIG. 4 is a block diagram of a display apparatus according to anexemplary embodiment;

FIG. 5 is views illustrating a method for displaying a control userinterface (UI), for controlling a peripheral device, on a displayapparatus, according to an exemplary embodiment;

FIG. 6 is views illustrating a method for displaying monitoring listinformation, about a peripheral device that is monitored, on a displayapparatus, according to an exemplary embodiment;

FIG. 7 is views illustrating a method for displaying a security UI, formonitoring a peripheral space through a peripheral device, on a displayapparatus, according to an exemplary embodiment;

FIG. 8 is views illustrating a method for displaying a control UI, forcontrolling a peripheral device, on a display apparatus, activated on alock screen, according to an exemplary embodiment;

FIG. 9 is views illustrating a method for displaying a security UI, formonitoring a peripheral space through a peripheral device, on a displayapparatus, activated on a lock screen, according to an exemplaryembodiment;

FIG. 10 is views illustrating a method for displaying a control UI on adisplay apparatus on which a home network service-related application isactivated, according to an exemplary embodiment;

FIG. 11 is views illustrating a method for monitoring a peripheralstatus through a peripheral device on a display apparatus, activated ona lock screen, according to another embodiment;

FIG. 12 is views illustrating a method for displaying a control UI on adisplay apparatus on which a home network service-related application isactivated, according to an exemplary embodiment;

FIG. 13 is a block diagram of a terminal apparatus according to anexemplary embodiment;

FIG. 14 is a flowchart of a method for controlling a display apparatus,according to an exemplary embodiment;

FIG. 15 is a flowchart of a method for generating a control UI forcontrolling a peripheral device on a display apparatus, according to anexemplary embodiment;

FIG. 16 is a flowchart of a method for generating a security UI formonitoring a peripheral device on a display apparatus, according to anexemplary embodiment; and

FIG. 17 is a flowchart of a method for controlling a terminal apparatus,according to an exemplary embodiment.

DETAILED DESCRIPTION OF THE EXEMPLARY EMBODIMENTS

Exemplary embodiments are described in greater detail with reference tothe accompanying drawings.

In the following description, the same drawing reference numerals areused for the same elements even in different drawings. The mattersdefined in the description, such as detailed construction and elements,are provided to assist in a comprehensive understanding of the exemplaryembodiments. Thus, it is apparent that the exemplary embodiments can becarried out without those specifically defined matters. Also, well-knownfunctions or constructions are not described in detail since they wouldobscure the exemplary embodiments with unnecessary detail.

FIG. 1 is a block diagram of a home network system according to anexemplary embodiment.

Referring to FIG. 1, the home network system includes four peripheraldevices 100-1 through 100-4, a terminal apparatus 200, a displayapparatus 300, and a relay server 400.

The four peripheral devices 100-1 through 100-4 may be home devicesinstalled in a home. According to an exemplary embodiment, the firstperipheral device 100-1 may be a smart electronic device such as a robotcleaner, a washing machine, a smart TV, or a refrigerator, the secondperipheral device 100-2 may be a security device such as an internetprotocol (IP) camera, a door lock, a closed-circuit television (CCTV)camera, a fire detector, or the like, the third peripheral device 100-3may be one of the various types of lighting equipment, and the fourthperipheral device 100-4 may be an energy device such as a boiler, an airconditioner, or the like. The four peripheral devices 100-1 through100-4 may perform wired or wireless communications through the terminalapparatus 200 and may be controlled according to a control command fromthe display apparatus 300.

The terminal apparatus 200 may be a home gateway and communicate withthe four peripheral devices 100-1 through 100-4 that are registered andthe display apparatus 300 via wire or wirelessly. In detail, theterminal apparatus 200 may periodically perform data communication withthe four peripheral devices 100-1 through 100-4 to store statusinformation about the four peripheral devices 100-1 through 100-4. Thestatus information may include activation information of the fourperipheral devices 100-1 through 100-4, communication status informationbetween the four peripheral devices 100-1 through 100-4 and the terminalapparatus 200, etc.

If a status information request message is received from the displayapparatus 300, the terminal apparatus 200 transmits status informationabout a controllable peripheral device or status information about aperipheral device that may be monitored, to the display apparatus 300based on the stored status information of the four peripheral devices100-1 through 100-4 based on a communication status with the displayapparatus 300. In detail, the terminal apparatus 200 may set one of theregistered four peripheral devices 100-1 through 100-4 selected by auser as a peripheral device that may be monitored and may store theperipheral device. Thus, the terminal apparatus 200 may transmit statusinformation about a controllable peripheral device or status informationabout a peripheral device that may be monitored, to the displayapparatus 300 based on stored status information based on acommunication status with the display apparatus 300. According to anexemplary embodiment, if a communication with the display apparatus 300is possible, the terminal apparatus 200 may receive the statusinformation request message from the display apparatus 300. In thiscase, the terminal apparatus 200 transmits status information about acontrollable peripheral device from among the four peripheral devices100-1 through 100-4 to the display apparatus 300 based on the storedstatus information. If the communication with the display apparatus 300is impossible, the terminal apparatus 200 may receive the statusinformation request message from the display apparatus 300 through therelay sever 400. In this case, the terminal apparatus 200 transmitsstatus information about one of the four peripheral devices 100-1through 100-4 that may be monitored, to the display apparatus 300 basedon the stored status information and setting information.

If communication between the terminal apparatus 200 and the displayapparatus is possible, the terminal apparatus 200 and the displayapparatus 300 exist on the same network. Therefore, the communicationbetween the terminal apparatus 200 and the display apparatus 300 may bedirectly performed through a short-range wireless communication.However, if communication between the terminal apparatus 200 and thedisplay apparatus 300 is impossible, the terminal apparatus 200 and thedisplay apparatus 300 exist on different networks. Therefore, thecommunication between the terminal apparatus 200 and the displayapparatus 300 is possible through the relay server 400.

The display apparatus 300 may generate and display a control userinterface (UI) for controlling at least one of the four peripheraldevices 100-1 through 100-4 based on the status information receivedfrom the terminal apparatus 200 or may generate and display a securityUI for monitoring at least one of the four peripheral devices 100-1through 100-4.

In detail, if status information about a controllable peripheral deviceis received from the terminal apparatus 200, the display apparatus 300may generate a control UI for controlling at least one of the fourperipheral devices 100-1 through 100-4 based on the received statusinformation. If status information about a peripheral device that may bemonitored is received from the terminal apparatus 200, the displayapparatus 300 may generate a security UI for monitoring a peripheralspace through at least one of the four peripheral devices 100-1 through100-4 based on the received status information.

However, if the status information request message is received from thedisplay apparatus 300 regardless of a communication status with thedisplay apparatus 300, the terminal apparatus 200 may transmit thestored status information about the four peripheral devices 100-1through 100-4.

In this case, the display apparatus 300 may generate a control UI or asecurity UI according to the communication status with the terminalapparatus 200. In detail, if the display apparatus 300 directlycommunicates with the terminal apparatus 200 by wireless, the displayapparatus 300 may generate a control UI for controlling at least one ofthe four peripheral devices 100-1 through 100-4 based on the statusinformation received from the terminal apparatus 200. If the displayapparatus 300 indirectly communicates with the terminal apparatus 200through the relay server 400, the display apparatus 300 may generate asecurity UI for monitoring at least one of the four peripheral devices100-1 through 100-4 based on the status information received from theterminal apparatus 200.

As described above, the display apparatus 300 of the home networksystem, according to the present exemplary embodiment, may generate acontrol UI for controlling at least one peripheral device installed in ahome according to a communication status between the terminal apparatus200 and the display apparatus 300 or may generate a security UI formonitoring a peripheral space through at least one peripheral device.Therefore, if a user of the display apparatus 300 stays in a home, theuser may control an operation of a peripheral device through the displayapparatus 300. If the user stays outside the home, the user may monitora status of the home/display device through the display apparatus 300 inreal time.

The above-described operation of the home network system will now bedescribed in more detail with reference to FIGS. 2 and 3.

FIG. 2 is a flowchart of a method for controlling a peripheral device ina home network system, according to an exemplary embodiment. FIG. 3 is aflowchart of a method for providing a security service by using a homedevice in the home network system, according to an exemplary embodiment.

Referring to FIG. 2, in operation S10, the terminal apparatus 200periodically requests status information of at least one registeredperipheral device 100. If the status information is received from the atleast one peripheral device 100 according to the request, the terminalapparatus 200 parses and stores the status information in operation S11.Here, the status information may include at least one of activationinformation including at least one of on/off information, settinginformation, sensing information of the peripheral device 100 andcommunication status information between the peripheral device 100 andthe terminal apparatus 200, according to an exemplary embodiment.

In operation S12, the display apparatus 300 generates a statusinformation request message for requesting the status information aboutthe at least one peripheral device 100 and transmits the statusinformation request message to the terminal apparatus 200 according to auser command. If the status information request message is received, theterminal apparatus 200 determines whether a direct communication ispossible with the display apparatus 200 that transmitted the statusinformation request message, in operation S13. In detail, the terminalapparatus 200 may determine whether the display apparatus 300 exists onthe same network using the received status information request message.If it is determined that the display apparatus 300 exists on the samenetwork, the terminal apparatus 200 transmits status information about acontrollable peripheral device, from among the stored statusinformation, about the at least one peripheral device 100, to thedisplay apparatus 300 in operation S14. If it is determined that thedisplay apparatus does not exist on the same network, the terminalapparatus 200 performs a monitoring-related operation in operation S15.In other words, if it is determined that the display apparatus 300 doesnot exist on the same network, the terminal apparatus 200 transmitsstatus information about a peripheral device that may be monitored, fromamong the stored status information, about the at least one peripheraldevice 100, to the display apparatus 300 through the relay server 400.The monitoring-related operation will be described later with referenceto FIG. 3.

If the status information about the controllable peripheral device 100is received from the terminal apparatus 200, the display apparatus 300generates control list information and a control UI based on thereceived status information in operation S16. Here, the control listinformation may be a list information about the controllable at leastone peripheral device 100, and the control UI may be a UI forcontrolling the peripheral device 100 selected from a plurality ofperipheral devices 100 by the user. If the controllable peripheraldevices 100 are the four peripheral devices 100-1 through 100-4 as inthe above-described exemplary embodiment with reference to FIG. 1, thedisplay apparatus 300 may generate and display control list informationincluding device information about the four peripheral devices 100-1through 100-4. If device information about the first peripheral device100-1 is selected by the user in response to the control listinformation being displayed, the display apparatus 300 may generate anddisplay a control UI including a control menu for controlling theselected first peripheral device 100-1, according to an exemplaryembodiment.

If a user command is input when the control UI is displayed, the displayapparatus 300 transmits a control command corresponding to the inputuser command to the terminal apparatus 200, and the terminal apparatus200 transmits the control command to the peripheral device 100 selectedby the user in operation S17. In operation S18, the peripheral device100 that receives the control command from the terminal apparatus 200performs a control operation based on the control command.

If it is determined in operation S13 that the display apparatus 300 andthe terminal apparatus 200 do not exist on the same network, theterminal apparatus 200 transmits status information about the peripheraldevice 100 that may be monitored, from among stored status information,about the at least one peripheral device 100, to the display apparatus300 through the relay server 400 in operation S20 as shown in FIG. 3. Ifthe status information is received, the display apparatus 300 generatesand displays security list information and a user certification UI basedon the received status information in operation S21. Here, the securitylist information may be list information about the peripheral device 100that may monitor a peripheral space, from among a plurality ofperipheral devices 100, according to an exemplary embodiment. Forexample, the first and second peripheral devices 100-1 and 100-2 of thefour peripheral devices 100-1 through 100-4 may be peripheral devicesthat may be monitored. In this case, the display apparatus 300 generatesand displays security list information including device informationabout the first and second peripheral devices 100-1 and 100-2 that maybe monitored. If the first peripheral device 100-1 is selected by theuser when the security list information is displayed, the displayapparatus 300 generates and displays the user certification UI todetermine whether the corresponding user is a registered user. If anencryption key is input by the user, the display apparatus 300determines whether the encryption key input from the user corresponds toa preset encryption information to determine whether the correspondinguser is a registered user in operation S22.

If it is determined that the corresponding user is a registered userthrough the user certification process, the display apparatus 300requests the terminal apparatus 200 through the relay server 400 tomonitor the peripheral device 100, previously selected by the user, inoperation S23. If a monitoring request message is received, the terminalapparatus 200 transmits a monitoring performance command to theperipheral device 100 requested by the user based on the receivedmonitoring request message in operation S24, and the peripheral device100 that receives the monitoring performance command captures an imageof a peripheral space based on the received monitoring performancecommand in operation S25. In operation S26, the peripheral device 100transmits captured image information to the terminal apparatus 200, andin operation S27 the terminal apparatus 200 transmits the captured imageinformation received from the peripheral device 100 to the displayapparatus 300 through the relay server 400. If the captured imageinformation is received, the display apparatus 300 generates a securityUI and displays the captured image information through the generatedsecurity UI in operation S28. Here, the security UI may include an imagecaptured by the peripheral device 100 and a monitoring control menu forcontrolling a monitoring operation of the corresponding peripheraldevice 100. The monitoring control menu may further include a firstcontrol menu for controlling an operation of the peripheral device 100that captures the image and a second menu for editing and storing theimage captured by the peripheral device 100. If a user command is inputwith respect to the first menu for controlling the operation of theperipheral device 100, the display apparatus 300 may transmit a controlcommand corresponding to the input user command to the terminalapparatus 200 through the relay server 400, and the terminal apparatus200 may transmit the corresponding control command to the peripheraldevice 100 that performs the monitoring-related operation. Therefore,the peripheral device 100 stops an image capturing operation or performsan operation of moving an image capturing direction or another operationbased on the control command received from the terminal apparatus 200 inoperation S29.

If the status information request message is received, the terminalapparatus 200 may not perform operation S13 as described above and maytransmit stored status information about at least one peripheral device100 to the display apparatus 300 directly or through the relay server400. In this case, the display apparatus 300 may generate a control UIfor controlling a controllable peripheral device 100 or a security UIfor controlling the peripheral device 100 that may monitor a peripheralspace, based on the status information of the at least one peripheraldevice 100, wherein the status information is transmitted from theterminal apparatus 200. In detail, if a direct communication with theterminal apparatus 200 is possible, the display apparatus 300 maygenerate control list information about the controllable peripheraldevice 100 based on the received status information. If the directcommunication with the terminal apparatus 200 is impossible, the displayapparatus 300 may generate security list information about theperipheral device 100 that may monitor the peripheral space, based onthe received status information. The terminal apparatus 200 and thedisplay apparatus 300 may generate a control UI for controlling theperipheral device 100 or a security UI for displaying image informationcaptured by the peripheral device 100 according to the operationsdescribed with reference to FIGS. 2 and 3.

Structures of the terminal apparatus 200 and the display apparatus 300will now be described in detail.

FIG. 4 is a block diagram of the display apparatus 300, according to anexemplary embodiment.

Referring to FIG. 4, the display apparatus 300 may be a portableterminal apparatus that performs wireless communications like asmartphone, a tablet PC, or the like and may include a communicator 310,a controller 320, a display unit 330, a storage unit 340, and an inputunit 350.

The communicator 310 wirelessly communicates with the terminal apparatus200, or the relay server 400 which in-turn communicates with theterminal apparatus 200, that communicates with the at least oneperipheral device 100 that is a home device installed in a home, toreceive the collected status information about the at least oneperipheral device 100 from the terminal apparatus 200. Here, the statusinformation may include at least one of activation information includingat least one of on/off information, setting information, sensinginformation of the peripheral device 100, and communication statusinformation between the peripheral device 100 and the terminal apparatus200, according to an exemplary embodiment.

The communicator 310 may be a wireless communication module and includeat least one of a short-range communication module (not shown) and awireless local area network (WLAN) module (not shown). Here, theshort-range communication module is a communication module that performsa wireless short-range communication between the display apparatus 300and the terminal apparatus 200 according to a control command of thecontroller 320. The short-range communication module may include atleast one of a Wi-Fi module, a Bluetooth module, an infrared dataassociation (IrDA) module, a near field communication (NFC) module, anda Zigbee module, according to an exemplary embodiment.

The WLAN module accesses the relay server 400 such as an access point(AP) (not shown) existing within a preset range to be connected to theInternet according to the control command of the controller 320. TheWLAN module supports WLAN standard IEEE802.11x of Institute ofElectrical and Electronic Engineers (IEEE).

The communicator 310 may further include at least one of a cellularcommunication module (not shown), a global positioning system (GPS)communication module (not shown), and a broadcast communication module(not shown). These communication modules are well-known technologies,and thus their detailed descriptions are omitted herein.

The controller 320 controls overall operations of the elements of thedisplay apparatus 300. In particular, the controller 320 may generate acontrol UI for controlling at the least one peripheral device 100 basedon status information of the at least one peripheral device 100 or maygenerate a security UI for monitoring a peripheral space through the atleast one peripheral device 100 according to whether a communicationwith the terminal apparatus 200 is possible.

The display unit 330 displays the generated control UI or security UI ona screen according to the control command of the controller 320. Thedisplay unit 330 may be realized as a touch screen that senses a touch,according to an exemplary embodiment.

In detail, if the collected status information regarding the at leastone peripheral device 100 is received from the terminal apparatus 200through the communicator 310, the controller 320 determines acommunication status with the terminal apparatus 200. According to anexemplary embodiment, if a communication with the terminal apparatus 200is possible, the controller 320 generates control list information abouta controllable peripheral device based on the received statusinformation about the at least one peripheral device 100. Here, if thecommunication with the terminal apparatus 200 is possible, the displayapparatus 300 may directly communicate with the terminal apparatus 200through a short-range wireless communication. If a direct communicationbetween the display apparatus 300 and the terminal apparatus 200 ispossible as described above, the controller 320 generates the controllist information regarding the controllable peripheral device based onthe received status information about the at least one peripheral device100 and displays the control list information through the display unit330.

If a command to select the peripheral device 100 is input through theinput unit 350 when the control list information is displayed on thescreen through the display unit 330, the controller 320 generates acontrol UI including a control menu for controlling the peripheraldevice 100 corresponding to the input command. Therefore, the displayunit 330 may display the control UI including the control menucorresponding to the peripheral device 100 selected by the user.

Here, the control list information may be list information includingdevice information about the controllable at least one peripheral device100. The input unit 350 receives a selection command according tovarious types of user controls of the user and transmits the selectioncommand to the controller 320. The input unit 350 may include a touchinput unit, such as a touch screen or a touch pad, and a key input unit,such as a key pad having various functional keys, numerical keys,character keys, etc.

Therefore, if a command to select the controllable peripheral device 100is input through the input unit 350 when the control list informationincluding the device information about the at least one peripheraldevice 100 is displayed, the controller 320 may generate a control UIincluding a control menu of the peripheral device 100 corresponding tothe input command, from among control menus of peripheral devices 100stored in the storage unit 340, and display the control UI through thedisplay unit 330.

The controller 320 that generates the control UI for controlling theselected peripheral device 100 as described above may differentlygenerate the control list information according to an execution mode ofthe display apparatus 300. Here, the execution mode may include at leastone of a first execution mode activated on a quick menu, a secondexecution mode activated on a lock screen, and a third execution mode inwhich a home network service-related application is activated, accordingto an exemplary embodiment.

In detail, in the first execution mode activated on the quick menu, thecontroller 320 may generate and display first control list informationincluding all controllable peripheral devices 100 based on the receivedstatus information. In the second execution mode activated on the lockscreen, the controller 320 may generate and display second control listinformation including the peripheral device 100 that is activated amongthe all controllable peripheral devices 100. In the third execution modein which the home network service-related application is activated, thecontroller 320 may generate and display a control UI includingstatus-related detailed information and a control menu of at least oneperipheral device 100 based on the received status informationregardless of whether a communication with the terminal apparatus 200 ispossible.

As described above, the controller 320 may differently generate controllist information and a control UI according to an execution mode of thedisplay apparatus 300 and display the control list information throughthe display unit 330. An operation of differently generating anddisplaying control list information and a control UI according to anexecution mode will now be described in detail.

If it is determined that the communication with the terminal apparatus200 is impossible, the controller 320 may generate security listinformation about the peripheral device 100 that may monitor aperipheral space, based on the received status information about the atleast one peripheral device 100 and setting information of eachperipheral device 100 registered in the storage unit 340 and display thesecurity list information through the display unit 330. Here, if thecommunication with the terminal apparatus 200 is impossible, the displayapparatus 300 and the terminal apparatus 200 may communicate with eachother through the relay server 400. The security list information mayinclude identification information indicating the peripheral device 100that may monitor the peripheral space and area information showing anarea that may be monitored through the corresponding peripheral device100.

If the display apparatus 300 and the terminal apparatus 200 indirectlycommunicate with each other through the relay server 400 as describedabove, the controller 320 may generate security list informationincluding identification information and area information of theperipheral device 100 that may be monitored, based on received statusinformation and registered setting information of at least oneperipheral device and display the security list information through thedisplay unit 330.

If a command to select the peripheral device 100, that may monitor aperipheral space, is input through the input unit 350 when the securitylist information is displayed, the controller 320 may generate a usercertification UI for certifying the user and display the usercertification UI through the display unit 330. If an encryption key isinput through the input unit 350 when the user certification UI isdisplayed, the controller 320 determines whether the input encryptionkey corresponds to a preset encryption information. If it is determinedthat the encryption key corresponds to the preset encryptioninformation, the controller 320 requests the terminal apparatus 200, viathe relay server 400, to monitor the peripheral device 100 correspondingto the input selection command. Therefore, the terminal apparatus 200transmits a monitoring performance command to the peripheral device 100that is requested to be monitored and, if image information of aperipheral space captured by the corresponding peripheral device 100 isreceived from the peripheral device 100, transmits the received imageinformation to the display apparatus 300 through the relay server 400.

If the image information is received, the controller 320 generates asecurity UI for displaying an image captured by the peripheral device100, that is requested to be monitored. The controller 320 controls thedisplay unit 330 to display the image corresponding to the receivedimage information through the generated security UI. Therefore, thedisplay unit 330 may display the image captured by the peripheral device100, that is requested to be monitored, in an area of the security UI.Therefore, the user may monitor a peripheral space, which is related tothe peripheral device 100 selected by the user, in real time through theimage displayed in the area of the security UI displayed on the screenof the display apparatus 300.

According to an exemplary embodiment, the controller 320 may generate asecurity UI including a monitoring control menu for controlling amonitoring operation of the peripheral device 100 that is requested tobe monitored. Also, the controller 320 may generate a security UIfurther including an editing menu for editing the image captured by theperipheral device 100, that is requested to be monitored. Here, themonitoring control menu may include at least one of a menu for switchingon and/or off the peripheral device 100 that is monitored, and a menufor controlling a monitoring direction of the corresponding peripheraldevice 100, according to an exemplary embodiment. The controlling menuis not limited thereto and may contain several other menus. The editingmenu may include at least one of a menu for capturing or recording theimage captured by the peripheral device 100, that is requested to bemonitored, and a menu for ending a currently displayed security UI,according to an exemplary embodiment.

Therefore, the user may control an operation of the peripheral device100 that is monitored or may edit the image captured by thecorresponding peripheral device 100 using the monitoring control menu orthe editing menu included in the security UI displayed on the screen ofthe display apparatus 300.

An operation of controlling at least one peripheral device 100 orproviding a security service through the at least one peripheral device100 in the display apparatus 300 will now be described in more detail.

FIGS. 5A and 5B are views illustrating a method for displaying a controlUI for controlling a peripheral device in a display apparatus, accordingto an exemplary embodiment.

The display apparatus 300 may directly perform a data communication withthe terminal apparatus 200 through a short-range wireless communicationto receive status information about at least one peripheral device 100from the terminal apparatus 200. If the status information is received,the display apparatus 300 generates and displays control listinformation about a controllable peripheral device 100 according to anexecution mode of the display apparatus 300.

In detail, as shown in FIG. 5A, if the execution mode of the displayapparatus 300 is a first execution mode activated on a quick menu, thedisplay apparatus 300 may generate and display first control listinformation 510 about all controllable peripheral devices 100 based onstatus information received from the terminal apparatus 200.

For example, the display apparatus 300 may receive status informationabout a smart TV, a robot cleaner, an air conditioner, and a smartwashing machine belonging to the first peripheral device 100-1 from theterminal apparatus 200. The display apparatus 300 may also store settinginformation for setting devices belonging to the four peripheral devices100-1 through 100-4. The setting information may include control menusof the devices belonging to the four peripheral devices 100-1 through100-4.

In this case, the display apparatus 300 may generate and display thefirst control list information 510 including identification iconsindicating the smart TV, the robot cleaner, the air conditioner, and thesmart washing machine belonging to the first peripheral device 100-1related to the received status information, from among the devicesbelonging to the four peripheral devices 100-1 through 100-4, based onthe received status information and stored setting information. If anidentification icon 511, indicating the smart TV according to anexemplary embodiment, is selected according to a request of the userwhen the first control list information 510 is displayed, the displayapparatus 300 may generate and display a control UI 520 including acontrol menu corresponding to the smart TV, based on a control menuincluded in the stored setting information, as shown in FIG. 5B.

As shown in FIG. 5B, the control UI 520 for controlling the smart TVcorresponding to the selected identification icon 511 may include acontrol menu for controlling a channel and a volume of the smart TV, acontrol menu for switching on and/or off the smart TV, etc. If thecontrol menu for switching on and/or off the smart TV 521 is selectedaccording to a user request when the control UI 520 including thecontrol menu is displayed, the display apparatus 300 transmits a controlcommand corresponding to the selected control menu to the terminalapparatus 200. Therefore, the terminal apparatus 200 may transmit thecontrol command to the smart TV based on the control command receivedfrom the display apparatus 300, and the smart TV may be switched onand/or off according to the received control command.

FIGS. 6A and 6B are views illustrating a method for displayingmonitoring list information about a peripheral device that may bemonitored, in a display apparatus, according to an exemplary embodiment.

The display apparatus 300 may indirectly perform a data communicationwith the terminal apparatus 200 through the relay server 400 to receivecollected status information about at least one peripheral device 100from the terminal apparatus 200. If the status information is received,the display apparatus 300 generates and displays monitoring listinformation about the peripheral device 100 that may be monitored,according to an execution mode of the display apparatus 300.

In detail, as shown in FIG. 6A, if the execution mode of the displayapparatus 300 is a first execution mode activated on a quick menu, thedisplay apparatus 300 may generate and display monitoring listinformation 610 about the peripheral device 100 that may be monitored,based on status information and registered setting information receivedfrom the terminal apparatus 200.

For example, the display apparatus 300 may receive status informationabout a smart TV, a robot cleaner, an air conditioner, and a smartwashing machine belonging to the first peripheral device 100-1 throughthe relay server 400. The display apparatus 300 may store settinginformation for setting the smart TV and the robot cleaner belonging tothe first peripheral device 100-1 of the four peripheral devices 100-1through 100-4 and setting information for a security device belonging tothe second peripheral device 100-2 to devices that may be monitored. Thesetting information for a security device may include identificationinformation indicating a device that may be monitored and areainformation showing an area of each device that may be monitored.

In this case, the display apparatus 300 displays a notification message610 notifying the number of devices that may be monitored among thesmart TV, the robot cleaner, the air conditioner, and the smart washingmachine belonging to the first peripheral device 100-1 related to thereceived status information, based on the received status informationand the stored setting information. If the notification message 610 isselected according to a user command, the display apparatus 300generates and displays monitoring list information 620 including theidentification information and the area information corresponding to thedevice that may be monitored.

If devices that may be monitored are the smart TV and the robot cleaneras in the above-described exemplary embodiment, the display apparatus300 may generate and display the monitoring list information 620including identification information (an identification icon) and areainformation indicating the smart TV and identification information (anidentification icon) and area information indicating the robot cleaneras shown in FIG. 6B.

If an identification icon 621 indicating the smart TV is selectedaccording to a request of the user when the monitoring list information620 is displayed, the display apparatus 300 may perform a usercertification and display an image captured by the smart TV through asecurity UI as shown in FIGS. 7A and 7B.

FIGS. 7A and 7B are views illustrating a method for displaying asecurity UI for monitoring a peripheral space through a peripheraldevice in a display apparatus, according to an exemplary embodiment.

If the identification icon 621 indicating the smart TV is selected asdescribed with reference to FIGS. 6A and 6B, the display apparatus 300generates and displays a user certification UI 710 for certifying a useras shown in FIG. 7A. If an encryption key is input by the user when theuser certification UI 710 is displayed, the display apparatus 300determines whether the input encryption key corresponds to a presetencryption information. If it is determined that the input encryptionkey corresponds to the preset encryption information, the displayapparatus 300 transmits a monitoring performance command for performinga monitoring-related operation to monitor the smart TV to the terminalapparatus 200 through the relay server 400. Therefore, the terminalapparatus 200 transmits the monitoring performance command to thesecurity device to monitor the smart TV based on the received monitoringperformance command. Therefore, the security device captures an image ofa peripheral space according to the monitoring performance commandreceived from the terminal apparatus 200 and transmits captured imageinformation to the terminal apparatus 200. The terminal apparatus 200transmits the image information received from the security device to thedisplay apparatus 300 through the relay server 400. If the imageinformation captured by the security device is received from theterminal apparatus 200 through the relay server 400, the displayapparatus 300 may generate a security UI and display the image capturedby the smart TV through the generated security UI as shown in FIG. 7B.

Here, as shown in FIG. 7B, the display apparatus 300 may display amonitoring control menu for controlling a monitoring operation ofmonitoring the smart TV in an area 720 of a security UI in which theimage captured by the security device is displayed. The displayapparatus 300 may display a security UI including an editing menu forediting the image captured by the smart TV in an area 730.

In detail, the display apparatus 300 may display a monitoring controlmenu in the area 720 of the security UI in which the image captured bythe security device is displayed. Here, the monitoring control menuincludes a direction menu 721 for changing a capturing area captured bythe security device and a control menu 723 for stopping the security UI.The display apparatus 300 may include a power menu 731 for controllingan operation of switching on and/or off the security device, a capturemenu 733 for capturing the image displayed in the area 720 of thesecurity UI, and a recording menu 735 for recording the correspondingimage in the area 720 of the security UI.

For example, if the user selects a direction menu for moving a capturingdirection into a left direction, the display apparatus 300 transmits acontrol command corresponding to the selected direction menu to theterminal apparatus 200 through the relay server 400, and the terminalapparatus 200 transmits the control command to the security device.Therefore, the security device moves the capturing direction into theleft direction based on the received control command to capture aperipheral space in the moved direction and transmit captured imageinformation to the terminal apparatus 200. Thereafter, the terminalapparatus 200 may transmit the image information captured by thesecurity device to the display apparatus 300 through the relay server400, and the display apparatus 300 may display the image that thesecurity device moves into the left direction to capture, in the area720 of the security UI.

If an identification icon of a robot cleaner, in which area information“Free Zone” is set, is selected as shown in FIG. 6B, the displayapparatus 300 may display an image captured by the robot cleaner throughthe above-described operation in the area 720 of the security UI. Here,if a direction menu displayed in the area 720 of the security UI isselected by the user, the display apparatus 300 transmits a controlcommand corresponding to the selected direction menu to the terminalapparatus 200 through the relay server 400, and the terminal apparatus200 transmits the control command to the robot cleaner. Therefore, therobot cleaner may move into a direction corresponding to the selecteddirection menu to capture an image, and the display apparatus 300 maydisplay the image that the robot cleaner moves into the directioncorresponding to the selected direction menu to capture, in the area 720of the security UI.

As described above, the display apparatus 300 may control a movement ofthe peripheral device 100 that may be monitored, in a camera capturingdirection and remotely move the corresponding peripheral device 100 tocapture an image. Therefore, the user may monitor all areas of a homethrough the display apparatus 300 in real time to check whether riskelements are detected.

FIGS. 8A and 8B are views illustrating a method for displaying a controlUI for controlling a peripheral device in a display apparatus activatedon a lock screen, according to an exemplary embodiment.

The display apparatus 300 may directly perform a data communication withthe terminal apparatus 200 through a short-range wireless communicationto receive status information about at least one peripheral device 100from the terminal apparatus 200. If the status information is received,the display apparatus 300 generates and displays control listinformation about a controllable peripheral device 100 according to anexecution mode of the display apparatus 300.

In detail, if the execution mode of the display apparatus 300 is asecond execution mode activated on a lock screen as shown in FIG. 8A,the display apparatus 300 may generate and display second control listinformation 810 about one of the activated controllable peripheraldevices 100 based on the status information received from the terminalapparatus 200.

For example, the display apparatus 300 may receive status informationabout a smart TV, a robot cleaner, an air conditioner, and a smartwashing machine belonging to the first peripheral device 100-1 from theterminal apparatus 200. The display apparatus 300 may also store settinginformation for setting devices belonging to the four peripheral devices100-1 through 100-4. The setting information may include a control menuof the devices belonging to the four peripheral devices 100-1 through100-4.

In this case, the display apparatus 300 classifies the smart TV, therobot cleaner, the air conditioner, and the smart washing machinebelonging to the first peripheral device 100-1, from among the devicesbelonging to the four peripheral devices 100-1 through 100-4, ascontrollable peripheral devices 100 based on the received statusinformation and the stored setting information. If the controllableperipheral devices 100 are classified, the display apparatus 300 mayclassify only devices, which operate in an activation mode, from amongthe smart TV, the robot cleaner, the air conditioner, and the smartwashing machine belonging to the first peripheral device 100-1, as thecontrollable peripheral devices 100, based on activation informationincluded in the receives status information.

The devices that operate in the activation mode may be in a mode inwhich the devices currently operate. For example, if the smart TV andthe air conditioner operate, from among the smart TV, the robot cleaner,the air conditioner, and the smart washing machine, the displayapparatus 300 may generate and display second control list information810 including identification icons indicating the smart TV and the airconditioner and activation information included in status information ofthe smart TV and the air conditioner.

Therefore, the second control list information 810 may includeactivation information including the identification icon and currentchannel information of the smart TV and activation information includingthe identification icon of the air conditioner and a current roomtemperature sensed by the air conditioner, according to an exemplaryembodiment.

If an identification icon 811 indicating the smart TV is selected by theuser when the second control list information 810 is displayed, thedisplay apparatus 300 may generate and display a control UI 820including a control menu corresponding to the smart TV, based on acontrol menu included in stored setting information, as shown in FIG.8B.

Therefore, the user may remotely control the smart TV through thecontrol menu included in the control UI 820.

FIGS. 9A through 9C are views illustrating a method for displaying asecurity UI for monitoring a peripheral space through a peripheraldevice in a display apparatus activated on a lock screen, according toan exemplary embodiment.

As shown in FIG. 9A, the display apparatus 300 may indirectly perform adata communication with the terminal apparatus 200, through the relayserver 400, to receive collected status information about at least oneperipheral device 100 from the terminal apparatus 200. If the statusinformation is received, the display apparatus 300 may generate anddisplay monitoring list information about the peripheral device 100 thatmay be monitored, according to an execution mode of the displayapparatus 300.

In detail, as shown in FIG. 9A, if the execution mode of the displayapparatus 300 is a second execution mode activated on a lock screen, thedisplay apparatus 300 may generate and display monitoring listinformation 910 about the peripheral device 100 that may be monitored,based on the status information and the stored setting informationreceived from the terminal apparatus 200.

For example, the display apparatus 300 may receive status informationabout a smart TV, a robot cleaner, an air conditioner, and a smartwashing machine belonging to the first peripheral device 100-1 throughthe relay server 400. The display apparatus 300 may also store settinginformation for setting the smart TV and the robot cleaner belonging tothe first peripheral device 100-1 and store setting information forsetting a security device belonging to the second peripheral device100-2 from among devices belonging to the four peripheral devices 100-1through 100-4. Also, the setting information may include identificationinformation indicating a peripheral device that may be monitored andarea information showing an area that may be monitored by each device.

In this case, the display apparatus 300 generates and displaysmonitoring list information 910 about a device that may be monitored,from among the smart TV, the robot cleaner, the air conditioner, and thesmart washing machine belonging to the first peripheral device 100-1,based on the received status information and the stored settinginformation. Here, the monitoring list information 910 may includeidentification icons identifying the smart TV and the robot cleaner andarea information showing an area that may be monitored through theselection of the smart TV and the robot cleaner.

If an identification icon 911 indicating the smart TV is selected by theuser when the monitoring list information 910 is displayed, the displayapparatus 300 generates and displays a user certification UI 920 forperforming a user certification as shown in FIG. 9B.

If an encryption key is input from the user when the user certificationUI 920 is displayed, the display apparatus 300 determines whether theinput encryption key corresponds to a preset encryption information. Ifthe input encryption key corresponds to the preset encryptioninformation, the display apparatus 300 determines that the usercertification is completed, and generates and displays a security UI 930for displaying an image captured by the security device covering theliving room/smart TV selected by the user as shown in FIG. 9C.

In detail, if the user certification is completed, the display apparatus300 transmits a monitoring performance command to the terminal apparatus200 through the relay server 400. Here, the monitoring performancecommand is to perform a monitoring-related operation through thesecurity device covering the living room/smart TV. Therefore, theterminal apparatus 200 transmits the monitoring performance command tothe security device covering the living room/smart TV based on thereceived monitoring performance command. Therefore, the security devicecovering the living room/smart TV captures an image of a peripheralspace and transmits the captured image information to the terminalapparatus 200 according to the monitoring performance command receivedfrom the terminal apparatus 200. Thereafter, the terminal apparatus 200transmits the image information transmitted from the security devicecovering the living room/smart TV to the display apparatus 300 throughthe relay server 400. If the image information captured by the securitydevice covering the living room/smart TV is received from the terminalapparatus 200 through the relay server 400, the display apparatus 300may generate a security UI 930 and display the image captured by thesecurity device covering the living room/smart TV through the generatedsecurity UI 930.

FIGS. 10A through 10C are views illustrating a method for monitoring aperipheral status through a peripheral device in a display apparatusactivated on a lock screen, according to an exemplary embodiment.

As shown in FIG. 10A, the display apparatus 300 may display a virtualobject on a screen in a second execution mode activated on a lockscreen. Here, the virtual object may include a home object 1010indicating a home of a user and a peripheral object 1040 indicating anenvironment status around the home of the user, according to anexemplary embodiment.

Therefore, the display apparatus 300 may provide a status of the homeaccording to an occurrence of an event through the home object 1010displayed on the lock screen, based on status information that iscorresponding to at least one peripheral device 100 and received throughthe relay server 400. The display apparatus 300 may also provide theenvironment status around the home of the user through the peripheralobject 1040 based on the status information about the at least oneperipheral device 100 or environment information received through a datacommunication with an external server (not shown).

As shown in FIG. 10B, the display apparatus 300 may parse an occurrenceof an event indicating whether the peripheral device 100 installed inthe home is behaving abnormally and/or is in operation, based on thereceived status information about the at least one peripheral device100. For example, if it is determined that the peripheral device 100 ofa smart illumination lamp installed in a living room is currentlyswitched on based on the received status information about the at leastone peripheral device 100, the display apparatus 300 displays a devicestatus icon 1020 in an area of the home object 1010.

Therefore, the user may recognize that at least one of the peripheraldevices 100 installed in the home is behaving abnormally and/or is inoperation, through the device status icon 1020 displayed on the homeobject 1010 displayed on the lock screen. The user may select the devicestatus icon 1020 displayed on the home object 1010 to recognize a moredetailed status. If a selection command, as described above, is input,the display apparatus 300 may display a control UI including detailedinformation and a control menu of the peripheral device 100corresponding to the occurrence of the event (the light bulb in theabove exemplary embodiment) on a screen displaying the lock screen (notshown).

In detail, if a command to select the device status icon 1020 is inputas in the above-described exemplary embodiment, the display apparatus300 may display a control UI, including detailed information “Theillumination lamp in the living room is switched on.” and a control menufor controlling switching on and/or off the illumination lamp, on thelock screen. Therefore, the user may determine that the illuminationlamp in the living room of the home is switched on and may switch offthe illumination lamp by using the control menu included in the controlUI.

As shown in FIG. 10C, the display apparatus 300 may parse whether asecurity-related event occurs, based on the received status informationabout the at least one peripheral device 100. For example, if it isdetermined that an event occurrence signal of the peripheral device 100is generated in a security system installed at a front door based on thereceived status information about the at least one peripheral device100, the display apparatus 300 displays a security warning icon 1030 inan area of the home object 1010.

Therefore, the user may recognize that a security problem such as anintrusion has occurred in the home, through the security warning icon1030 displayed in the home object 1010 displayed on the lock screen, andselect the security warning icon 1030 to recognize a detailed status. Ifthe security warning icon 1030 is selected, the display apparatus 300may generate a security UI as shown in FIGS. 9A through 9C and displayan image captured by the at least one peripheral device 100 through thegenerated security UI.

Therefore, the user may monitor an indoor security status in real timeusing the image displayed through the security UI of the displayapparatus 300.

FIGS. 11A through 11C are views illustrating a method for monitoring aperipheral status through a peripheral device in a display apparatusactivated on a lock screen, according to another exemplary embodiment.

As shown in FIG. 11A, the display apparatus 300 may display a homeobject 1110 indicating a home of a user on a screen in a secondexecution mode activated on a lock screen.

When the home object 1110 is displayed on the lock screen, as shown inFIG. 11B, the user may select an area 1020 of the home object 1110 tocheck who stays in the home and perform a dragging operation in a presetdirection based on the selected area 1020. If a touch command of theuser is input, the display apparatus 300 determines that the touchcommand is a command to request an indoor family member status, andgenerates and displays a family monitoring UI 1030 for showing a familymember status in the home based on received status information about atleast one peripheral device 100, as shown in FIG. 11C.

In detail, the status information that is about the at least oneperipheral device 100 and received from the relay server 400 may includestatus information about home devices such as the four peripheraldevices 100-1 through 100-4 and status information about a peripheraldisplay apparatus (not shown) existing on the same network as theterminal apparatus 200. The status information about the peripheraldisplay apparatus existing on the same network as the terminal apparatus200 may include at least one of user information and device informationof the peripheral display apparatus.

Therefore, if a user command to request the family status is input, thedisplay apparatus 300 may acquire the user information and the deviceinformation of the peripheral display apparatus based on the statusinformation about the peripheral display apparatus, from among thereceived status information. If the user information and the deviceinformation are acquired, the display apparatus 300 extracts user faceimages corresponding to the acquired user information and displays theextracted user face images on family list information 1040 of the familymonitoring UI 1030. Therefore, as shown in FIG. 11C, the displayapparatus 300 may display the family monitoring UI 1030, including thefamily list information 1040 providing user face images corresponding tofamily members staying in the home, on the lock screen. Therefore, theuser may check who stays in the home, through the family listinformation 1040 of the family monitoring UI 1030 displayed on the lockscreen of the display apparatus 300.

As shown in FIG. 11C, the user may select a first family member 1050 offamily members provided through the family list information 1040. Ifsuch a selection command is input, the display apparatus 300 initiates acall to a display apparatus (not shown) of the first family member 1050corresponding to the input selection command based on stored contactinformation. Therefore, the user may call family members through thefamily list information 1040 without being additionally well-acquaintedwith or inputting the contact information that belongs to the familymembers.

FIGS. 12A and 12B are views illustrating a method for displaying acontrol UI in a display apparatus in which a home networkservice-related application is activated, according to an exemplaryembodiment.

As shown in FIG. 12A, the display apparatus 300 may execute a homenetwork-related application 1210 according to a request of the user. Ifthe home network-related application 1210 is executed, the displayapparatus 300 may generate and display a control UI 1230 includingstatus-related detailed information and a control menu of thecorresponding peripheral device 100 based on status information that isabout at least one peripheral device 100 and received through theterminal apparatus 200 or the relay server 400, regardless of whether acommunication with the terminal apparatus 200 is possible.

Here, the peripheral devices 100 may include home devices such as thefour peripheral devices 100-1 through 100-4 and a peripheral displayapparatus (not shown) existing on the same network as the terminalapparatus 200. In this case, status information about the peripheraldisplay apparatus, existing on the same network as the terminalapparatus 200, may include at least one of user information and deviceinformation of the peripheral display apparatus (not shown).

Therefore, if the home network service-related application 1210 isexecuted as shown in FIG. 10A, the display apparatus 300 may provide abriefing menu 1220, which is to show user information of a user stayingin the home and a current status of the peripheral device 100corresponding to dynamic elements, from among the four peripheraldevices 100-1 through 100-4, through the home network service-relatedapplication 1010. Here, the dynamic elements may include an illuminationintensity, a temperature, and TV editing information, and the peripheraldevices 100 performing operations of the dynamic elements may be a smartillumination lamp, an air conditioner, and a smart TV, according to anexemplary embodiment.

If the briefing menu 1220 is selected by the user when the home networkservice-related application 1010 is executed, the display apparatus 300may display a control UI 1230 including status-related detailedinformation about the peripheral device 100 corresponding to the dynamicelements and a control menu for controlling the corresponding peripheraldevice 100, based on the received status information. Here, the controlmenu displayed in the control UI 1230 may be a menu for controlling abasic operation of each peripheral device 100 (for example, an operationof switching on and/or off each peripheral device 100, an operation ofrecording a program, or the like). The status-related detailedinformation may be detailed result information that is parsed based onstatus information about the peripheral device 100 corresponding to thedynamic elements.

In detail, if a command to select the briefing menu 1220 is input, thedisplay apparatus 300 may display the control UI 1230 including detailedresult information, which is parsed based on status information aboutthe smart illumination lamp, the air conditioner, and the smart TVcorresponding to the dynamic elements, and a control menu forcontrolling operations of the smart illumination lamp, the airconditioner, and the smart TV, according to an exemplary embodiment.

In other words, as shown in FIG. 12B, the display apparatus 300 maydisplay the control UI 1230 including detailed result information “Thesmart illumination lamp is switched off. Do you want to switch on thesmart illumination lamp?” and a control menu for switching on and/or offthe smart illumination lamp in relation to the smart illumination lamp,and detailed result information “The room temperature is higher than anappropriate temperature. Do yon want to switch on the air conditioner?”and a control menu for operating the air conditioner in relation to theair conditioner.

Therefore, the user may control the corresponding peripheral device 100by using a control menu corresponding to the peripheral device 100 thatis to be controlled, using the detailed result information about theperipheral device 100 corresponding to the dynamic elements.

FIG. 13 is a block diagram of the terminal apparatus 200, according toan exemplary embodiment.

Referring to FIG. 13, the terminal apparatus 200 includes a communicator210, a storage unit 220, and a controller 230.

The communicator 210 periodically communicates with registered at leastone peripheral device 100 via a wired connection or wirelessly toreceive status information from the at least one peripheral device 100.The communicator 210 also communicates with the display apparatus 300 orthe relay server 400. Here, the status information may include at leastone of activation information including at least one of on/offinformation, setting information, and sensing information of theperipheral device 100 and communication status information between theperipheral device 100 and the terminal apparatus 200, according to anexemplary embodiment.

The storage unit 220 stores the status information of the at least oneperipheral device 100 received through the communicator 210. The storageunit 220 may further include identification information of the displayapparatus 300 existing on the same network, identification informationof the relay server, etc.

If a status information request message of the peripheral device 100 isreceived from the display apparatus 300, the controller 230 controls thecommunicator 210 to transmit status information about a controllableperipheral device 100 or status information about a peripheral device100 that may be monitored, to the display apparatus 300 based on thestatus information of the at least one peripheral device 100 stored inthe storage unit 220 according to whether a communication with thedisplay apparatus 300 is possible.

In detail, if the communication with the display apparatus 300 ispossible (i.e., the terminal apparatus 200 exists on the same network asthe display apparatus 300), the controller 230 transmits the statusinformation about the controllable peripheral device 100 to the displayapparatus 300 based on the status information of the at least oneperipheral device 100 stored in the storage unit 220. If a controlcommand is received from the display apparatus 300 that receives thestatus information about the controllable peripheral device 100, thecontroller 230 transmits the received control command to thecorresponding peripheral device 100. Therefore, the correspondingperipheral device 100 may perform an operation based on the receivedcontrol command.

If the communication with the display apparatus 300 is impossible (i.e.,the terminal apparatus 200 exists on a different network from thedisplay apparatus 300 and thus receives the status information requestmessage from the display apparatus 300 through the relay server 400),the controller 230 transmits the status information about the peripheraldevice 100 that may be monitored, to the display apparatus 300 throughthe relay server 400 based on the status information of the at least oneperipheral device 100 stored in the storage unit 220.

If a monitoring performance command is received from the displayapparatus 300 through the relay server 400, the controller 230 transmitsthe monitoring performance command to the corresponding peripheraldevice 100. The peripheral device 100 that receives the monitoringperformance command captures an image of a peripheral space according tothe monitoring performance command and transmits captured imageinformation to the terminal apparatus 200. Thereafter, the controller230 may transmit the image information received from the peripheraldevice 100 to the display apparatus 300 through the relay server 400.

If a direct data communication with the display apparatus 300 ispossible as described above, the terminal apparatus 200 transmits thestatus information about the controllable peripheral device 100 to thedisplay apparatus 300 based on the stored status information about theat least one peripheral device 100. Therefore, the display apparatus 300may generate and display a control UI for controlling the peripheraldevice 100 based on the received status information, and the user maycontrol the peripheral device 100 installed in the home through thecontrol UI displayed on the display apparatus 300.

If an indirect data communication with the display apparatus 300 ispossible through the relay server 400, the terminal apparatus 200transmits the status information about the peripheral device 100 thatmay be monitored, to the display apparatus 300 based on the storedstatus information about the at least one peripheral device 100.Therefore, the display apparatus 300 may generate a security UI formonitoring a peripheral space based on the received status informationand display an image, which is captured by the peripheral device 100, asrequested by the user, through the generated security UI. As a result,the user may monitor the image captured by the peripheral device 100selected by the user through the security UI displayed on a screen ofthe display apparatus 300 to check in real time whether risk elementsare detected in the home.

A method of controlling operations of the display apparatus 300 and theterminal apparatus 200 will now be described in detail.

FIG. 14 is a flowchart of a method for controlling the display apparatus300, according to an exemplary embodiment.

Referring to FIG. 14, in operation S1410, the display apparatus 300communicates with the terminal apparatus 200 or the relay server 400 toreceive collected status information about at least one peripheraldevice 100 from the terminal apparatus 200. Here, the status informationmay include at least one of activation information including at leastone of on/off information, setting information, sensing information ofthe peripheral device 100 and communication status information betweenthe peripheral device 100 and the terminal apparatus 200, according toan exemplary embodiment.

If the status information about the at least one peripheral device 100is received in operation S1410, the display apparatus 300 determineswhether a communication with the terminal apparatus 200 is possible inoperation S1420. In detail, if a direct data communication with theterminal apparatus 200 is not possible through a short-range wirelesscommunication, the display apparatus 300 determines whether an indirectdata communication with the terminal apparatus 200 is possible throughthe relay server 400.

If it is determined in operation S1420 that the direct datacommunication with the terminal apparatus 200 is possible through theshort-range wireless communication, the display apparatus 300 generatesand displays a control UI for controlling the at least one peripheraldevice 100 based on the received status information about the at leastone peripheral device 100 in operation S1430.

If it is determined in operation S1420 that indirect data communicationwith the terminal apparatus 200 is possible through the relay server400, the display apparatus 300 generates and displays a security UI formonitoring a peripheral space through the at least one peripheral device100 based on the received status information about the at least oneperipheral device 100 in operation S1440.

A method of generating a control UI for controlling at least oneperipheral device 100 or a security UI for monitoring a peripheral spacethrough the at least one peripheral device 100 according to acommunication status between the display apparatus 300 and the terminalapparatus 200 will now be described in detail.

FIG. 15 is a flowchart of a method for generating a control UI forcontrolling a peripheral device in a display apparatus, according to anexemplary embodiment.

Referring to FIG. 15, if it is determined that a direct datacommunication with the terminal apparatus 200 is possible through ashort-range wireless communication, the display apparatus 300 generatesand displays control list information about a controllable peripheraldevice 100, based on received status information about at least oneperipheral device 100, in operation S1510. If a command to select atleast one peripheral device 100 is input from a user when the controllist information is displayed, the display apparatus 300 generates anddisplays a control UI including a control menu for controlling theperipheral device 100, corresponding to the input command, in operationS1520. Here, the control list information may be list informationincluding device information about at least one controllable peripheraldevice 100.

Therefore, if a command to select the controllable peripheral device 100is input when the control list information including the deviceinformation about the at least one peripheral device 100 is displayed,the display apparatus 300 may generate and display the control UIincluding a control menu for controlling the peripheral device 100corresponding to the input command, from among stored control commandsof respective peripheral devices 100.

The display apparatus 300 that generates and displays the control UI forcontrolling the selected peripheral device 100 as described above maydifferently generate the control list information according to anexecution mode. Here, the execution mode may include at least one of afirst execution mode activated on a quick menu, a second execution modeactivated on a lock screen, and a third execution mode in which a homenetwork service-related application is activated. However, the executionmodes are not limited thereto.

In the first execution mode activated on the quick menu, the displayapparatus 300 may generate and display first control list informationincluding all controllable peripheral devices 100 based on receivedstatus information. In the second execution mode activated on the lockscreen, the display apparatus 300 may generate and display secondcontrol list information including an activated peripheral device 100,from among all controllable peripheral devices 100. In the thirdexecution mode in which the home network service-related application isactivated, the display apparatus 300 may generate and display a controlUI including status-related detailed information and a control menu ofat least one peripheral device 100 based on received status informationregardless of whether a communication with the terminal apparatus 200 ispossible.

As described above, the display apparatus 300 may differently generateand display the control list information and the control UI according toan execution mode that is currently executed.

If a command to select at least one control menu is input when a controlUI including a plurality of control menus is displayed, the displayapparatus 300 transmits a control command related to a control menu,corresponding to the input command, to the terminal apparatus 200, inoperation S1530. Thereafter, the terminal apparatus 200 transmits thecontrol command to the peripheral device 100 selected by the user basedon the control command received from the display apparatus 300. As aresult, the peripheral device 100 that receives the control command fromthe terminal apparatus 200 may perform a control operation based on thereceived control command.

FIG. 16 is a flowchart of a method for generating a security UI formonitoring a peripheral device in a display apparatus, according to anexemplary embodiment.

Referring to FIG. 16, if it is determined that an indirect communicationwith the terminal apparatus 200 is possible through the relay server400, the display apparatus 300 generates and displays security listinformation about a peripheral device 100 that may be monitored, basedon received status information about the peripheral device 100 andsetting information of each registered peripheral device 100 inoperation S1610. Here, the security list information may includeidentification information indicating the peripheral device 100 that maymonitor a peripheral space/may be monitored in a peripheral space by asecurity device and area information showing an area that may bemonitored through the corresponding peripheral device 100.

If a command to select the peripheral device 100 that may monitor theperipheral space is input when the control list information isdisplayed, the display apparatus 300 generates and displays a usercertification UI for certifying a user in operation S1620.

If an encryption key is input when the user certification UI isdisplayed, the display apparatus 300 determines whether the inputencryption key corresponds to a preset encryption information inoperation S1630. If it is determined in operation S1630 that theencryption key corresponds to the preset encryption information, thedisplay apparatus 300 requests the terminal apparatus 200, through therelay server 400, to monitor the peripheral device 100 corresponding tothe input selection command in operation S1640. The terminal apparatus200 transmits a monitoring performance command to the peripheral device100 that is requested to be monitored, according to the monitoringrequest and, if captured image information of the peripheral space isreceived from the corresponding peripheral device 100, transmits thereceived image information to the display apparatus 300 through therelay server 400.

If the image information is received, the display apparatus 300generates a security UI for displaying an image captured by theperipheral device 100 and displays an image corresponding to thereceived image information in an area of the generated security UI inoperation S1650.

Therefore, the user may monitor, in real time, the peripheral spacerelated to the peripheral device 100 selected by the user through theimage displayed in the area of the security UI displayed on a screen ofthe display apparatus 300.

The display apparatus 300 may generate and display a security UIincluding a monitoring control menu for controlling a monitoringoperation of the peripheral device 100 that is requested to bemonitored. Also, the display apparatus 300 may generate and display asecurity UI further including an editing menu for editing the imagecaptured by the peripheral device 100, that is requested to bemonitored.

Here, the monitoring control menu, for example, may include at least oneof a menu for switching on and/or off the peripheral device 100 thatperforms monitoring and a menu for controlling a monitoring direction ofthe corresponding peripheral device 100, according to an exemplaryembodiment. Also, the editing menu may include at least one of a menufor capturing or recording the image captured by the peripheral device100, that is requested to be monitored, and a menu for stopping acurrently displayed security UI. Therefore, if a command to select themonitoring control menu is input using the security UI, the displayapparatus 300 transmits a control command corresponding to the inputcommand to the terminal apparatus 200, through the relay server 400, inoperation S1660. Thereafter, the terminal apparatus 300 may transmit thecorresponding control command to the peripheral device 100 thattransmits the captured image, and the peripheral device 100 thatreceives the control command may perform a control operation based onthe received control command.

Therefore, the user may monitor, in real time, a status of the homethrough the image displayed in the area of the security UI displayed onthe screen of the display apparatus 300, and control a capturingoperation of the peripheral device 100 or edit the image captured by thecorresponding peripheral device 100 through the monitoring control menuor the editing menu incorporated in the security UI.

FIG. 17 is a flowchart of a method for controlling the terminalapparatus 200, according to an exemplary embodiment.

Referring to FIG. 17, the terminal apparatus 200 periodicallycommunicates with the registered at least one peripheral device 100 toreceive and store status information about the at least one peripheraldevice 100 in operation S1710. Here, the status information may includeat least one of activation information including at least one of on/offinformation, setting information, sensing information of the peripheraldevice 100 and communication status information between the peripheraldevice 100 and the terminal apparatus 200, according to an exemplaryembodiment.

If a status information request message requesting the statusinformation of the peripheral device 100 is received from the displayapparatus 300, the terminal apparatus 200 determines whether acommunication with the display apparatus 300 is possible in operationsS1720 and S1730.

In detail, if the status information request message is received fromthe display apparatus 300, the terminal apparatus 200 may determine thatthe terminal apparatus 200 exists on a network on which the terminalapparatus 200 directly communicates with the display apparatus 300(i.e., the terminal apparatus 200 exists on the same network as thedisplay apparatus 200). If it is determined that the status informationrequest message is received from the display apparatus 300 through therelay server 400, the terminal apparatus 200 may determine that theterminal apparatus 200 indirectly communicates with the displayapparatus 300 (i.e., the terminal apparatus 200 exists on a differentnetwork from the display apparatus 300).

If it is determined that the status information request message isreceived through a direct communication with the display apparatus 300as described above, the terminal apparatus 200 transmits statusinformation about a controllable peripheral device 100 to the displayapparatus 300, based on stored status information about the at least oneperipheral device 100, in operation S1740.

If a control command is received from the display apparatus 300, theterminal apparatus 200 transmits the received control command to theperipheral device 100 corresponding to the received control command.Therefore, the peripheral device 100 may perform an operation based onthe received control command.

If it is determined that the status information request message isreceived from the display apparatus 300 through the relay server 400,the terminal apparatus 200 transmits status information about theperipheral device 100 that may be monitored, to the display apparatus300 through the relay server 400, based on the stored status informationabout the at least one peripheral device 100, in operation S1750.

If a monitoring performance command is received through the relay server400, the terminal apparatus 200 transmits the monitoring performancecommand to the peripheral device 100 corresponding to the receivedmonitoring performance command. The peripheral device 100 that receivesthe monitoring performance command captures an image of a peripheralspace according to the received monitoring performance command andtransmits the captured image information to the terminal apparatus 200.If the image information is received, the terminal apparatus 200 maytransmit the image information regarding the image captured by theperipheral device 100 to the display apparatus 300 through the relayserver 400.

Therefore, the user may monitor the image captured by the peripheraldevice 100 selected by the user through the security UI, displayed onthe screen of the display apparatus 300, to check in real time whetherrisk elements are detected in the home.

According to various exemplary embodiments described above, a displayapparatus may control a home device that is a peripheral deviceaccording to a communication status with a terminal apparatus or monitoran environment status of a home through an image captured by the homedevice in real time.

The foregoing exemplary embodiments and advantages are merely exemplaryand are not to be construed as limiting. The present teaching can bereadily applied to other types of apparatuses. Also, the description ofthe exemplary embodiments is intended to be illustrative, and not tolimit the scope of the claims, and many alternatives, modifications, andvariations will be apparent to those skilled in the art.

What is claimed is:
 1. A display apparatus comprising: a communicatorconfigured to communicate with at least one of a terminal apparatus anda relay server to receive from the terminal apparatus collected statusinformation corresponding to at least one peripheral device; a displayunit configured to display a user interface (UI) screen; and acontroller configured to generate at least one of a control UI forcontrolling the at least one peripheral device and a security UI formonitoring a peripheral space using the at least one peripheral devicebased on the status information corresponding to the at least oneperipheral device and based on whether communication with the terminalapparatus is possible, and display the at least one of the control UIand the security UI on the display unit.
 2. The display apparatus ofclaim 1, wherein, if communication with the terminal apparatus ispossible, the controller generates a control list information about atleast one controllable peripheral device, from among the at least oneperipheral device, based on the received status information, andgenerates the control UI comprising a control menu corresponding to oneof the at least one controllable peripheral device selected based on thecontrol list information.
 3. The display apparatus of claim 1, wherein,if communication with the terminal apparatus is not possible, thecontroller generates a security list information comprisingidentification information indicating the at least one peripheral deviceto be monitored and an area information depicting a monitoring areabased on the received status information and setting informationcorresponding to each of the at least one peripheral device.
 4. Thedisplay apparatus of claim 3, wherein the controller is furtherconfigured to : generate a user certification UI for certifying a userin response to one of the at least one peripheral device being selectedbased on the security list information, request the terminal apparatus,using the relay server, to monitor the selected one of the at least oneperipheral device in response to an encryption key input on the usercertification UI corresponding to preset encryption information, andgenerate a security UI for displaying image information that is capturedby the selected peripheral device and received from the relay server,according to the monitoring request.
 5. The display apparatus of claim4, wherein the security UI comprises a monitoring control menu forcontrolling a monitoring operation of the selected peripheral device. 6.The display apparatus of claim 5, wherein the security UI furthercomprises an editing menu for editing an image captured by the selectedperipheral device.
 7. The display apparatus of claim 2, wherein thecontroller generates the control list information based on an executionmode of the display apparatus, wherein the execution mode is at leastone of a first execution mode activated on a quick menu, a secondexecution mode activated on a lock screen, and a third execution mode inwhich a home network service-related application is activated.
 8. Thedisplay apparatus of claim 7, wherein the controller generates a firstcontrol list information comprising the at least one controllableperipheral devices in the first execution mode and generates a secondcontrol list information comprising one activated controllableperipheral device from among the at least one controllable peripheraldevice in the second execution mode.
 9. The display apparatus of claim7, wherein, if in the third execution mode, the controller generates acontrol UI comprising status-related detailed information and a controlmenu of the at least one controllable peripheral device based on thereceived status information regardless of whether communication with theterminal apparatus is possible.
 10. A terminal apparatus comprising: acommunicator configured to periodically communicate with at least oneperipheral device; a storage unit configured to store status informationabout the at least one peripheral device; and a controller configuredto, in response to a status information request message requestingstatus information of the at least one peripheral device being receivedfrom a display apparatus, control the communicator to transmit, to thedisplay apparatus, at least one of status information about at least onecontrollable peripheral device, from among the at least one peripheraldevice, and the status information about the at least one peripheraldevice to be monitored based on the status information stored in thestorage unit and based on whether a communication with the displayapparatus is possible.
 11. The terminal apparatus of claim 10, wherein,if communication with the display apparatus is possible, the controllertransmits the status information about the at least one controllableperipheral device based on the status information stored in the storageunit and, in response to a control command being received from thedisplay apparatus, transmits the control command to one of the at leastone controllable peripheral device corresponding to the received controlcommand.
 12. The terminal apparatus of claim 10, wherein, ifcommunication with the display apparatus is not possible, the controllertransmits the status information about the at least one peripheraldevice to be monitored to the display apparatus through a relay serverbased on the status information stored in the storage unit and, inresponse to a monitoring performance command being received from thedisplay apparatus through the relay server, transmits the monitoringperformance command to one of the at least one peripheral devicecorresponding to the monitoring performance command, and transmits imageinformation captured by the one of the at least one peripheral device tothe display apparatus through the relay server according to themonitoring performance command.
 13. A method of controlling a displayapparatus, the method comprising: periodically communicating with aterminal apparatus or a relay server to receive collected statusinformation about at least one peripheral device from the terminalapparatus; generating at least one of a control UI for controlling theat least one peripheral device and a security UI for monitoring aperipheral space through the at least one peripheral device based on thestatus information about the at least one peripheral device and based onwhether a communication with the terminal apparatus is possible; anddisplaying the at least one of the control UI and the security UI. 14.The method of claim 13, wherein the generating at least one of thecontrol UI and the security UI comprises: if communication with theterminal apparatus is possible, generating control list informationabout at least one controllable peripheral device, from among the atleast one peripheral device, based on the status information; and inresponse to one of the at least one controllable peripheral device beingselected based on the control list information, generating the controlUI comprising a control menu corresponding to the selected controllableperipheral device.
 15. The method of claim 13, wherein the generating atleast one of the control UI and the security UI comprises: ifcommunication with the terminal apparatus is not possible, generatingsecurity list information comprising identification informationindicating the at least one peripheral device to be monitored and anarea information depicting a monitoring area based on the statusinformation and setting information corresponding to each of the atleast one peripheral device.
 16. The method of claim 15, wherein thegenerating at least one of the control UI and the security UI furthercomprises: generating a user certification UI for certifying a user inresponse to one of the at least one peripheral device being selectedbased on the security list information; requesting, in response to anencryption key input on the user certification UI corresponding topreset encryption information, the terminal apparatus, using the relayserver, to monitor the selected peripheral device; and generating, inresponse to image information being captured by the selected peripheraldevice and being received according to the monitoring request, thesecurity UI for displaying the received image information.
 17. Themethod of claim 16, wherein the security UI further comprises amonitoring control menu for controlling a monitoring operation of theselected peripheral device.
 18. The method of claim 17, wherein thesecurity UI further comprises an editing menu for editing an imagecaptured by the selected peripheral device.
 19. The method of claim 14,wherein the control list information is generated based on an executionmode of the display apparatus, wherein the execution mode is at leastone of a first execution mode activated on a quick menu, a secondexecution mode activated on a lock screen, and a third execution mode inwhich a home network service-related application is activated.
 20. Themethod of claim 19, wherein the generating of the control listinformation comprises: generating a first control list informationcomprising the at least one controllable peripheral device in the firstexecution mode; and generating a second control list informationcomprising one activated controllable peripheral device from among theat least one controllable peripheral device in the second executionmode.
 21. The method of claim 19, wherein the generating of the controlUI comprises: if in the third execution mode, generating the control UIcomprising status-related detailed information and a control menu of theat least one controllable peripheral device based on the received statusinformation regardless of whether communication with the terminalapparatus is possible.
 22. A method of controlling a terminal apparatus,the method comprising: periodically communicating with at least oneperipheral device to receive status information about the at least oneperipheral device; storing the received status information about the atleast one peripheral device; receiving a status information requestmessage requesting status information of the at least one peripheraldevice from a display apparatus; and transmitting at least one of statusinformation about at least one controllable peripheral device, fromamong the at least one peripheral device, and the status informationabout the at least one peripheral device to be monitored, to the displayapparatus based on the stored status information and based on whetherthe communication with the display apparatus is possible.
 23. The methodof claim 22, wherein the transmitting of the status informationcomprises: if communication with the display apparatus is possible,transmitting the status information about the at least one controllableperipheral device to the display apparatus based on the stored statusinformation; and in response to a control command being received fromthe display apparatus, transmitting the control command to one of the atleast one controllable peripheral device corresponding to the receivedcontrol command.
 24. The method of claim 22, wherein the transmitting ofthe status information comprises: if communication with the displayapparatus is not possible, transmitting the status information about theat least one peripheral device to be monitored, to the display apparatusthrough a relay server based on the stored status information; inresponse to a monitoring performance command being received from thedisplay apparatus through the relay server, transmitting the monitoringperformance command to one of the at least one peripheral devicecorresponding to the monitoring performance command; and transmittingimage information captured by the one of the at least one peripheraldevice to the display apparatus through the relay server according tothe monitoring performance command.
 25. A method of controlling at leastone peripheral device, the method comprising: transmitting, to the atleast one peripheral device, a request for status information of the atleast one peripheral device; receiving, from the at least one peripheraldevice, the requested status information; generating at least one of acontrol user interface (UI) for controlling the at least one peripheraldevice and a security UI for monitoring a peripheral space using the atleast one peripheral device based on the received status information anda communication status information; and transmitting, to the at leastone peripheral device, a user command to control the at least oneperipheral device, input by a user in the at least one of the control UIand the security UI.